Click any tag below to further narrow down your results
Links
OpenAI introduces LifeVal, an evaluation of everyday practical tasks like finding housing, managing budgets, accessing government services, and shopping, which the company used to track ChatGPT's progress over the past year. The goal is to measure whether AI can take actions that actually get things done, not just give advice.
- The tasks were chosen from areas where users most want help: caregiving, health, education, household administration, personal finances, shopping, and government services.
- The benchmark tests action-taking, such as adding a deed to a cart for review, rather than only chat-style answers.
- OpenAI says it has used LifeVal to track and drive model improvement on everyday tasks over the past year, and frames it as a step beyond academic knowledge tests.
@lennysan on X
Tibo Sottiaux, Head of ChatGPT and Codex at OpenAI, shares his predictions from a conversation with Lenny Rachitsky: agents will soon handle most internet actions, the model picker will disappear, and today's clever agent scaffolding will become obsolete as models improve. He also covers what skills matter now, how OpenAI hires, and the burnout risk of running dozens of agents at once.
- Most internet actions will be taken by agents, and Notion's MCP server launch already showed how quickly agent traffic can strain a product's systems and economics.
- Tibo expects models to get dramatically better and cheaper, so he advises building as if they will be about 10 times better within a year, and he says his own forecast was too slow.
- Agent teams should grow and shrink with each model release, since a larger model can absorb tasks that once needed elaborate loops and graphs.